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The aim of the article is to develop a formal methodology for quantitative 
assessment of the quality of acontrol in a closed system with feedback in the 
context of digital transformation. In the proposed study, attention is focused 
on assessing the quality of management in organizational and technical 
systems on the example of the aviation industry. The following hypotheses 
were adopted in the study: in the digital management of business processes of 
an economic entity, the role of intellectual support is acquired by methods of 
formal description of processes: control, decision-making and corrective 
action on the control object. In critical situations, the psychotype of the person 
making the decision acquires a decisive role. The study solves two scientific 
and practical problems: development of a formal method for quantitative 
assessment of the quality of management of a complex multi-criteria 
organizational and technical system under the conditions of statistical 
uncertainty of management agents, taking into account feedback in the 
management of an object; formalization of the process of quantitative 
assessment of decision-making risks in the environment of statistical 
uncertainty of control agents and psychological factors of the decision maker. 
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1. INTRODUCTION 


To achieve the goal, it is proposed to solve by improving the information and analytical support of 
the management system. In the proposed study, two scientific and practical tasks are solved: the development 
of a formal method for quantitative assessment of the quality of management of a complex multi-criteria 
organizational and technical system under the conditions of statistical uncertainty of management agents, 
taking into account feedback in the management of an object. Formalization of the process of quantitative 
assessment of decision-making risks in the environment of statistical uncertainty of control agents and 
psychological factors of the decision maker. 

One of the current and dominant hypotheses proposed in this study is based on the paradigm that the 
quality of decision-making is a systemic convergence of heterogeneous processes, where the psychological 


Journal homepage: http://ijeecs.iaescore.com 


Indonesian J Elec Eng & Comp Sci ISSN: 2502-4752 O 1429 


type of the person making the decision plays a decisive role. At the heart of almost every management decision 
there is a so-called "human factor". Herbert Simon with co-authors on this subject considers: “the choice that 
an individual makes in a given situation consists of his skills, knowledge, character and personality traits in the 
form in which they were formed by all previous life experience, and from specific influences, to which he is 
exposed at the time of the decision. In most cases, the former is much more important in determining his 
behavior than the latter” [1]. 

At present, in connection with the adoption of a new version of the ISO 2015 standard, which includes 
a regulation - to assess the quantitative value of decision-making risks in the form of "producer risk" and 
"consumer risk". To achieve this goal, a special supplement to the standard has been developed: IEC 31010 
“Risk Management. Practices in the field of risk assessment” [2]. The decisive difference of ISO 9001:2015 
compared to previous versions of ISO should be considered that “risks are no longer hidden in the standard; 
risk assessment is now built into the management system and becomes its integral property’. Quantitative risk 
assessment in the management system is fundamentally possible only by formal methods and tools. 


2. FORMAL METHOD AND RISK ASSESSMENT MODELS 

In the classical and modern science of digital management, it is believed that the management system 
is based on four functions: organization, planning, motivation, and control. In many studies, control is 
considered locally in an open system without taking into account feedback [3], [4]. The influence of feedback 
on the quality of the control process, and its impact on the system, was first considered. Closed systems are 
used in practice to accurately achieve the control goal [5], [6]. Control is present to varying degrees in all 
management functions but is often singled out as a separate organizational or technological system agent. 

In this paper, the main attention is focused on the control function, which in the structural 
interpretation can be represented as in Figure 1. This figure shows a graphical model of a control system with 
feedback, which implements the restoration of the normative functional qualities of an object based on the 
results of control. The following notation is given in the figure: F(x) — information under study; f(s) — controlled 
information; Smeas — measured information; Z(Smeas) is a function of corrective action on the object (process) of 
control. As follows from Figure 1, the control of the system dynamics of an object, on a conditional universal 
example, is a multi-agent composition. Similar models for controlling the functional stability of a technical 
system are considered in works [7]-[9]. 
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Figure 1. Agent-based model for managing the functional stability of an organizational and technical system 


The control system contains, as follows from Figure 1, the function of controlling a certain flow of 
information F(x). The set of functional parameters F(x) at the input of the control system has a natural physical 
nature. In a real situation, it is not always possible to measure the selected physical parameters in existing units 
of measurement, and then they resort to replacing them with indirect ones, informationally correlated with 
physical parameters, which are called diagnostic S. In Figure 1, the set {Si} is a set of diagnostic parameters, 
and f(s) is a function of the distribution density of some conditional diagnostic parameter. As follows from 
Figure 1, the process of managing the organizational and technical system consists of the following sequence: 
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measurement - comparison of the measured value with the standard - analysis of the result - decision making. 
In most of the known works, this is the end of the control process [10]. At the same time, the main attention 
was focused on the quantitative assessment of control errors (control risks), which were functions of the 
statistical properties and characteristics of the above agents of the control system [1 1]-[16]. 

Statistical properties were hypothetically understood as distribution laws and three laws were studied: 
the normal law of distribution of a random variable (Gauss' law), the Weibull law, and the equiprobable law. 
Probabilistic and simulation models were proposed for quantitative assessment and forecasting of control risks. 
Thus, Makenov ef al. [11], Kornev et al. [12] the issues of the software for the diagnostic process were studied 
in order to assess the influence of various factors on the result of diagnosis, especially on control errors, which 
are considered control risks. The influence of statistical laws of distribution of diagnostic parameters on 
probable errors of diagnosis was studied. At the same time, different initial hypotheses and statistical conditions 
are proposed in all studies. Probabilistic models are presented for estimating control errors with a lower limit 
of the controlled parameter, which have the following form: 
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where, the probability of an undetected failure is Pus, and the probability of a false failure is — Py. 

An undetected failure is considered to be the case when the controlled parameter is outside the 
permissible limits, and the control system registers this fact as the parameter being in the tolerance zone. And 
vice versa, when the controlled parameter is outside the tolerance zone, and the control system registers this 
fact as the parameter being in the tolerance zone. The above models use the hypothesis that the statistical laws 
of distribution of all model parameters belong to the Gaussian law. 

Alibekkyzy et al. [7], Kornev et al. [12] the hypothesis of the distribution of a diagnostic parameter 
according to the Weibull law, and other parameters according to the Gauss law, is studied. Using the integral 
function of the Weibull law, an expression was obtained in the final form for calculating the probabilities of a 
false failure — R¢, and the probability of an undetected failure - Pur. 
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Yesmagambetova et al. [16], the hypothesis of non-deterministic norms is studied. The standards are 
designated as: S; - lower standard and S, - upper standard and their statistical characteristics in the form of 
distribution laws, 
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to study this hypothesis, a simulation approach was used, and a computer experiment was implemented. 

The given examples realize only particular cases of the system composition of the initial conditions 
of the simulation. Radjabov [8], a study was conducted to identify the total number of possible hypothetical 
combinations of the initial conditions for modeling. As a result, the following table was built: 

In Table 1, as an example, only a part of the variant combinations is given, both between agents and 
the statistical distribution laws of the parameters of control agents. The total number of all possible 
compositions of control agents and statistical laws for only one controlled indicator, as the calculation shows, 
will be 729 combinations. Each combination of distribution laws is described by a specific mathematical or 
simulation model. The choice of distribution laws is determined by a specific practical task and are determined 
experimentally. 
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Table 1. Possible combinations of distribution laws for the initial conditions of the control system [8] 
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Modeling of flight processes and control of complex dynamic objects is considered in [17]. But in this 
paper, the possibilities of using well-known universal modeling tools, such as Simscape MultibodyTM, are 
explored. The use of statistical approaches for modeling nonlinear systems and processes is proposed in [18], 
where the main tool is correlation analysis. However, the correlation coefficients of 0.9999 show that the 
studied variants are of a deterministic nature. In these works, it is noted that in the conditions of digital 
transformation of real digital models of dynamic objects, mathematical and simulation approaches for 
managing control risks are the intellectual support for control processes. The multiparametric nature and 
industry-specific requirements for business process quality management systems in the digital transformation 
environment in relation to the aviation industry give rise to the need for an optimal approach to choosing the 
parameters of agents and control processes. 

The results of control are informational in nature and are not the final assessment of the effectiveness 
and efficiency of the management process. The performance in the control system is determined by feedback, 
and especially by the statistical properties of the feedback link. The risks at the output of the control agent are 
transformed by the feedback link and are “summed up” with the complement of the feedback [6]. The study of 
the statistical influence of the feedback link on the quality of control seems to be extremely important, and 
methodologically necessary, since without feedback, the meaning and possibility of control is lost. 

An important problem in system and operational management and the task that is given attention in 
this paper is the assessment of the influence of mental factors on the decision-making process (PPR). In the 
scope of this topic, most of the works focused on the problem of qualitative analysis of the decision-making 
process, taking into account mental factors, and extremely rare works on modeling and quantifying the degree 
of their influence on the results of subjective management. The beginning of the psychological study of 
decision making as an interdisciplinary problem was laid by Ward Edwards in 1954, who can be called the 
founder of the study of the behavior of a real subject at the time of decision making [3]. One of the founders 
of the nature of the human psyche is the Swiss psychologist Carl Gustav Jung (1875-1961). In his fundamental 
work “Psychological Types”, Jung singled out extraverted and introverted psychotypes and four “mental 
functions”: thinking, feelings, sensations and intuition. The theory of psychological types was further 
developed in the works of A. Augustinavichute, Katharina Briggs, and Isabelle Briggs-Myers, as well as in 
domestic and foreign studies [19]. 

Such qualities of a decision maker (DM) as romanticism and practicality, optimism and pessimism 
are of great importance. One and the same person in different circumstances can be either a reinsurer or an 
adventurer, can both succeed and fail. The optimism of decision makers is often based on an overestimation of 
both their own capabilities and the prevailing circumstances. In any decision-making situation, there is always 
an acceptable “corridor” of possible outcomes, i.e. The decision maker is given the right to choose the best 
option on the principle of maximum utility and be responsible for this decision. The pessimism of the decision 
maker is based on an underestimated "bar" of their capabilities, and the prospects for the situation, while 
considering that an underestimated and stable option will be implemented without fail. Pessimism often 
manifests itself as excessive caution. This approach is typical for conservative processes. It is practically 
impossible to evaluate the entire set of variant compositions as shown in Table 1, including taking into account 
psychological factors, in one narrow problem under study, since the entire set of statistical risks in this 
environment represents a certain virtual space. In accordance with modern digital concepts, this virtual 
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environment is a "virtual reality" and part of the "metaverse" [20]. "Metaverse", as noted in the publications, 
"is not a new term." The first concepts of the metaverse had only fantastic outlines associated with travel 
outside the galaxy. It is a cross between the real and fictional world. At present, the concept of "metaverse" has 
begun to acquire practical contours and penetrate many areas of life, such as: social networks, the real estate 
sector, investments, work, augmented reality, the cryptocurrency world, and online games. The new digital 
paradigm is to "look at life beyond the boundaries of ordinary understanding". Ultimately, a new digital 
approach called “digital transformation” is generated and proposed in [21]-[23]. Digital transformation, both 
at the functional and technological levels, has not yet acquired clear contours and differences from the 
traditional definition - digitalization. Attention is drawn to this fact and studied in detail in [24], [25]. The work 
[24] provides an extensive and in-depth analysis of the current state of digital transformation, which was made 
based on a study of 206 peer-reviewed articles. In the author's analysis of this subject matter state, the scientific 
and practical areas of digital transformation were considered and directions for future research are suggested. 
The analysis shows that the new digital reality has its own specifics in each business project and "managers 
must adapt their business strategy to new" digital technologies. 

The work [25] proposes the results of a study to give a clear definition of the term "digitalization" and 
to distinguish between similar terms. The paper notes that the main goal of the transition to new digital 
technologies, especially the approach that integrates all known technologies, called "digital transformation", is 
the hope of increasing its competitive advantage, relying on service virtualization. Studying the new regulations 
and standards that have recently appeared in connection with the upcoming digital transformation, the 
following should be noted: at present, risk is an integral part of a person's "digital" life and is present in virtual 
and real forms of being, largely determining the "quality of life". at all stages of the life cycle. 


2.1. Scientific problem 

In the proposed study, attention is focused on assessing the quality of management in organizational 
and technical systems using the example of dynamic processes. The main scientific and practical idea of the 
study is to study the quality factors of managing complex multi-parameter systems under conditions of 
statistical uncertainty and fuzzy data, which lead to risks at the decision-making stage. The total management 
risk contains subjective and instrumental components. In connection with the introduction of artificial 
intelligence technologies in the digital transformation environment, the subjective component of risk is 
decreasing, but at the same time, the instrumental component of risk is increasing. The subjective risk factor is 
largely determined by the psychotype of the decision maker in the final phase of control. The instrumental 
component of risk is determined by the accuracy of control. Quantitative differentiated forecasting of these 
system components of risk by using formal methods is the research task. Integrated management risk 
assessment involves the study of a closed system at the stages of control, decision-making and correction of 
the result by a feedback link, taking into account its statistical properties, which is also the task of the study. 
Thus, the proposed study solves two scientific and practical problems: the development of a formal method for 
quantitative assessment of the quality of management of a complex multi-criteria organizational and technical 
system under the conditions of statistical uncertainty of management agents, taking into account feedback in 
the management of an object; formalization of the process of quantitative assessment of decision-making risks 
in the environment of statistical uncertainty of control agents and psychological factors of the decision maker. 


3. METHOD 
3.1. Research methods and materials 

The work consists of theoretical studies based on a formal platform and experimental studies on the 
example of observing real mass dynamic processes. As the studied "human factor", the behavior and decision- 
making of a person in complex dynamic conditions of a traffic flow was evaluated, followed by psychological 
testing. For the processing of experimental data, the apparatus of mathematical statistics and the professional 
software package statistica were used. At the final phase of the research, an assessment is made of the adequacy 
of theoretical premises to practical data from the field of operation of real objects. The first step in the control 
process is the measurement operation. There are systematic and random errors in the measurement procedure. 
Systematic can be studied and eliminated or compensated. Random error is present in each case and is studied 
to identify statistical characteristics. The most important characteristic of a random error is the law of 
distribution. In most control and measurement problems, it is considered that the theoretical distribution of the 
measurement result is approximated by the normal law. In several recent works, it is proved that no more than 
60% of measurements follow this law, and about 40% of measurements can be approximated by the Weibull 
laws and the equiprobable law. In literary sources and Internet resources, the concept of error is declared by 
the concept of "uncertainty". 
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3.2. Modeling the quality of feedback in the system control and decision making 

The management process, as follows from Figure 1, consists of a sequence of steps. The first stage of 
control is the measurement of some controlled parameter in the information flow, which has a random nature 
and is indicated in the figure as Si. If the control is carried out by a set of parameters, then at the input of the 
control system there will be a set {Si}. The second operation is the comparison of the measured result with the 
standard values, which, as follows from Table 1, can limit the controlled parameter from below and be 
designated SI, or limit from above and be designated St. If the standard has a two-sided restriction, then this is 
called a tolerance, which is determined from the expression A=St-SI. If the controlled parameter is objectively 
or falsely registered outside the limits, then it becomes necessary to adjust the process. Correction is an 
operation to restore the functional performance of the control object. Regardless of the type of control process, 
the results of monitoring and restoring the normative functionality are of a stochastic nature, due to the 
uncertainty of the parameters and control conditions. Uncertainty generates errors and control risks [8]-[10]. In 
these studies, we limited ourselves to the consideration of the control system without taking into account 
feedback. But as follows from the classical works on processes and control systems, it is the feedback that 
ensures the stability of the system and the quality of the system as a whole. Therefore, considering all external 
and internal factors, it is legitimate to put forward a hypothesis about the random nature of the process of 
restoring the quality of the functioning of the system, and the statistical distribution density function of the 
correction result is designated as Z(S) Figure 1. In this formulation of the problem, it is advisable to use a 
simulation approach to develop a closed-loop control model. Graphical interpretation of the simulation process 
is shown in Figure 2. 

Functionally and technologically, in real cases, the control unit and the “restoration of normative 
functions” unit appear to be autonomous systems. Figure 2 shows three distribution densities: f(S) is the 
distribution density function of the controlled parameter; @(Smeas) — distribution density function of the 
measurement result; Y(Sp) is the distribution density function of the result of restoring the normative state of 
the object. To implement the computer experiment, a software application was developed, and testing of the 
simulation algorithm was implemented. Figures 3 and 4 show the results of the experiment. 
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Figure 2. Graphical interpretation of the simulation process control and restoration of the normative 
parameters of the object 
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The figures show the results of control and correction at two values of feedback uncertainties after 
one cycle of correction of the controlled parameter. The correction results are presented as a distribution 
polygon of the correction result. The real objects of control refer to multi-parameter stochastic systems, which 
gives rise to the phenomenon of an integral property in the quality control of the entire system. To assess the 
functional or consumer quality of the system, they control a certain reasonable set of indicators, both 
differentiated by each indicator, and by the integral criterion of the quality of the object as a whole. The question 
of choosing and substantiating differentiated indicators (parameters) of control and the development of an 
integral quality criterion are, as a rule, the subject of a separate study in each specific case. 


4. RESULTS OF THE RESEARCH 

Modeling the quality of management, taking into account the psychotype of the decision maker. 
Practice and many theoretical studies prove that in decision-making, especially in critical situations, the 
subjective factor plays a decisive role, which is correlated with the psychotype of the person making the 
decision. This problem in the science of management is given considerable attention in the studies of many 
authors, but the main attention in the studies is focused on qualitative analysis. It is not possible to evaluate or 
predict quantitatively the influence of the psychological component on the result of decision-making, since it 
is extremely difficult to describe mathematically the actions of a person in a given situation. 

To solve the problem of quantitative assessment of management results, taking into account 
psychological factors, the following hypotheses were adopted in the work: 

— The results of decision-making are of a statistical nature; 

— Mathematically, the result of the solution is approximated by a statistical distribution; 

—  Psychotype of the person making the decision is mathematically described by the statistical law of 
distribution. 

To implement experimental statistical studies in this task, the problem arises of choosing a specific 
professional activity, where the psychotype of a person is quite clearly manifested, which is objectively 
recorded in regulatory documents and is easily provided by a representative volume of statistical sampling. 
These requirements are fully met by such an activity as driving a car, both at a professional and amateur level. 
To identify the driver's psychotype, special tests are used. The Eysenck questionnaire [26] was used as the 
baseline test in this study. In case of difficulties with adequate interpretation of the results, additional testing 
was catried out using a self-test questionnaire. The Eysenck questionnaire, designed to diagnose the individual 
psychological properties of a person, contains 57 questions. In practice, speed control was carried out by 
employees of the state inspectorate. 

To establish the type of distribution laws at the first stage of the statistical study, an empirical 
distribution function of the entire set of observations was constructed in the form of a histogram of test scores 
according to the Eysenck questionnaire, which is shown in Figure 5. A visual analysis of the histogram shows 
that it has a three-module form, which allows us to put forward a hypothesis that the total set of measured data 
is a composition of three qualitatively heterogeneous samples with the corresponding distribution laws. At the 
first stage, three hypothetical samples were selected from the total population, for each of them empirical 
distribution functions were constructed in the form of histograms, and the main statistical characteristics were 
calculated. The empirical distribution function for the first sample - the supposed "pure introvert" (inhibited, 
cautious type) will have the following form Figure 6. For the second selected sample - "neuroticism" (rational 
type), the empirical distribution function will have the form represented by the histogram in Figure 7. For the 
third sample - "pure extrovert" (risk-oriented, optimist), the distribution function will have the following form 
Figure 8. 
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To statistically test the hypothesis of qualitative heterogeneity of the three samples presented above, 
two methods were used: a method based on the use of the Fisher criterion and a method of qualitative difference 
in arithmetic means using t-statistics. The student statistic t, is calculated, on the basis of which a decision is 
made according to the formula: 
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t 


as a result, it was found that the hypothesis about the homogeneity of the samples and according to this method 
is rejected with a confidence level of 0.95. Further research was focused on the group of pure extraversion, as 
this group is the most psychologically risk-averse. 

At this stage, the first task was to study the relationship between the speed regime of drivers and test 
scores. For this purpose, a group of drivers (extraverts) was identified from the entire flow of traffic participants 
on a controlled section of the road, and the speed of movement of each driver from this group was recorded. 
The next step was to calculate the main statistics and identify the distribution law, for which a distribution 
histogram was built, shown in Figure 9. 
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Figure 9. Histogram of the speed regime for the group "pure extrovert" (optimist) 
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As a result of a visual study of the shape of the histogram, two hypotheses about the distribution law 
were put forward: the hypothesis of the normal distribution law and the hypothesis of distribution according to 
the Weibull law. Evaluation of hypotheses according to the standard method using the Pearson criterion showed 
that the Weibull law is the most acceptable. 

The analytical form of the distribution density of the Weibull law has the following form [11]: 
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where @ - scale parameter; B - form parameter; y - position parameter. 
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Form parameter B=1.75; a=1; y = 90. 
Using the experimental data, as well as (1) and (2), the parameters B, a, y, were found, the values of which are: 
B=2.65, a=1, y=80. 

The next task was to quantify the risk of speeding violations by extrovert drivers. By analyzing 
empirical data, it was found that the probability of a risk of violation of the speed limit, for the maximum 
permissible speed on the highway of 110 km/h, is 0.47 (P=0.47). The results of measuring the vehicle speed in 
this case contain an instrumental error inherent in control devices. 

To solve this problem, it is necessary to develop some model that would allow, given statistical 
parameters and distribution laws, to quantify and predict the level of risks in the control system. There is a 
probabilistic solution to this problem. However, in this case, the use of simulation modeling seems to be a more 
effective solution. 

The error distribution, as a rule, is approximated by a normal law, the probability density function of 
which, in analytical form, has the following form: 
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where Vi - is the current speed value; oy - is the standard deviation of the measurement error. 

The simulation model algorithm works as follows. The values Vay, Vp, GO, Gy, N are entered, where N is 
the number of simulations. Random value generators are connected according to the laws of Weibull and Gauss. 
One cycle of simulations includes: generating Vi, then analyzing IF>V,, where V, is the limit, generating the 
measurement procedure Vimeas, comparing the measurement result Vimem With the standard V), if the measurement 
result Vimeas turned out to be less than V,, then this is an error and the value of the error counter increases by unit. 
This is repeated N times, after which the number in the counter Num is divided by N, which will be the probability 
of a false marriage (solution) - Rm. Then, the previously found risk probability P is corrected (decreased) by the 
value of Pim. Graphical interpretation of the results of a computer simulation experiment is shown in Figure 10. 
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Figure 10. Reliability of decisions made in the vehicle control system 
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The middle curve corresponds to risky driving. Hypothetically, it was assumed that more accidents 
occur with risky object management (driving a car) than with other driving principles. However, the results of 
modeling driving outcomes, taking into account the model of the psychotype of a car driver and experimental 
data, do not confirm this hypothesis. This can be explained by the fact that risk subjects (cholerics) show high 
reactivity in dangerous situations. The greatest danger, both for the subject of control and for the environment, 
is very careful driving (pessimists). 

These results may have practical applications in other industries, for example, in aviation and UAV 
control, where the "human factor" plays both a positive and a negative role. Special tests are already being used 
to identify psychological professional suitability, but they can be used as an information tool for a preliminary 
assessment of the quality of personnel. More advanced and promising technologies for these purposes open up 
digital transformation technologies, and especially the digital twin. 


5. CONCLUSION 

The purpose of the study is to formalize the methodology for quantitative risk assessment of control 
and decision-making under the conditions of statistical uncertainty of control agents and digital transformation 
of business processes. For a comparative analysis of systemic risks, simulation models of quantitative risk 
assessment for an open-loop system and a closed-loop system with feedback have been developed. The study 
has developed intellectual support for digital transformation processes in the format of a structural-functional 
and simulation description of control processes, decision-making and corrective action on the control object. 
In this context, two scientific and practical tasks were solved in the study: a simulation model of quantitative 
risk assessment of management of a complex multi-criteria organizational and technical system in the 
conditions of statistical uncertainty of management agents, taking into account feedback in the management of 
the object, was developed; a simulation algorithm for quantitative risk assessment of decision-making in the 
environment of statistical uncertainty of management agents and psychological factors of the decision-maker 
was developed. The psychological type of the person making the decision as a feedback link is described by 
the functions of statistical distribution according to the laws revealed empirically. Digital transformation 
technology is implemented using big data statistical reporting to build adequate management risk assessment 
models. Scientific and practical results of research are applicable in the control system of manned and 
unmanned vehicles. The proposed methodology should be considered as one of the approaches in the general 
task of quantitative assessment and predicting risks in the decision-making process, taking into account the 
psychological type of a person in complex dynamic conditions. 
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